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Examiner's Detailed Office Action 

1. This Office Action is responsive to the communication for application 10/758,322, filed 
February 26, 2008. 

2. Claims 1, 3, 5 and 8-12 are pending. Claims 1, 8, 11, and 12 are currently amended. Claims 

2. 4, 6, and 7 are cancelled. Claims 3 and 5 are previously presented. Claims 9 and 10 are 
original. 

3. After the previous office action, claims 1, 3, 5 and 8-12 stood rejected. 

4. Examiner withdraws the finality of the previous office action. 

Objections to the Claims 

5. Claims 1,8, 11, and 12 are objected to because of the following informalities: 

In claim 1 : "A method for improving a neural network prediction" should be —A method for 
making a neural network prediction- as there is no recited interaction between the convex 
envelop and the neural network which results in the parameters of the neural network being 
modified ("improved") where the convex hull and neural network disagree on the classification 
of an input data record. 

In claim 1 : "(a) storing training input data records, forming the convex envelope by means of the 
training input data records" should be —(a) storing training input data records, forming the 



Application/Control Number: 10/758,322 Page 3 

Art Unit: 2129 

convex envelope by computing multiple simplexes using the training input data records— since 
that is the critical method recited for training. 

In claim 1 : "(c) delivering result that" should be —(c) delivering the result that—. 
In claim 1 : "(d) improving the neural network prediction by disregarding the input data record if 
it is outside the working range of the used neural network and processing by the used neural 
network the input data record if it is inside the working range" should be -(d) making the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
used neural network and processing the input data record by the used neural network if it is 
inside the working range— as there is no recited interaction between the convex envelop and the 
neural network which results in the parameters of the neural network being modified 
("improved") where the convex hull and neural network disagree on the classification of an input 
data record. 

In claim 8: "A system for improving a neural network prediction" should be —A system for 
making a neural network prediction- as there is no recited interaction between the convex 
envelop and the neural network which results in the parameters of the neural network being 
modified ("improved") where the convex hull and neural network disagree on the classification 
of an input data record. 

In claim 8: "(d) improving the neural network prediction" should be —(d) making the neural 
network prediction— for the reasons stated above. 

In claim 8: "means for improving" should be -means for making- for the reasons stated above. 



Application/Control Number: 10/758,322 
Art Unit: 2129 



Page 4 



In claim 8: "the improving means" should be —the prediction means— for the reasons stated 
above. 

In claim 1 1 : "A method for improving a neural network prediction" should be -A method for 
making a neural network prediction— for the reasons stated above. 

In claim 1 1 : "(b) checking whether the input data record is in the convex envelope, in checking 
whether there is a hyper-plane which contains the input data so that all the training input data 
records are located on one side of the hyper-plane" should be -(b) checking whether the input 
data record is in the convex envelope by checking whether there is a hyper-plane of the convex 
envelope such that all the training input data records are located on the same side of the hyper- 
plane as the input data record—. 

In claim 1 1 : "(d) improving the neural network prediction by disregarding the input data record 
if it is outside the working range of the used neural network and processing by the used neural 
network the input data record if it is inside the working range." should be —(d) making the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
used neural network and processing the input data record by the used neural network if it is 
inside the working range-. 

In claim 12: "A method for improving a neural network prediction" should be — A method for 
making a neural network prediction—. 
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In claim 12: "(a) storing training input data records for the neural network, forming the convex 
envelope by means of the training input data records" should be --(a) storing training input data 
records, forming a convex envelope using the training input data records— for clarity. 

In claim 12: "(d) improving the neural network prediction by disregarding the input data record 
if it is outside the working range of the used neural network and processing by the used neural 
network the input data record if it is inside the working range" should be —(d) making the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
used neural network and processing the input data record by the used neural network if it is 
inside the working range— for clarity. 

Appropriate correction is required. 

Claim Rejections - 35 USC § 1 12, 1 st 

6. The following is a quotation of the first paragraph of 35 U.S.C. 1 12: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to 
which it pertains, or with which it is most nearly connected, to make and use the same and shall set forth 
the best mode contemplated by the inventor of carrying out his invention. 

7. Amended claims 1,3,5, and 8-12 are rejected under 35 U.S.C. 1 12, first paragraph, as failing 
to comply with the enablement requirement. The claim(s) contains subject matter which was not 
described in the specification in such a way as to enable one skilled in the art to which it pertains, 
or with which it is most nearly connected, to make and/or use the invention. Amended 
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independent claims 1, 8, 1 1, and 12 recite "improving a neural network prediction. . .based on 
whether the input data record is in a working range of a neural network". Paragraph [0016] of 
the Specification states only that a "neural network is trained using these training data records, 
that is to say the weightings of the neurons are adapted iteratively". No disclosure of how a 
training or input data record being inside or outside of a convex envelope (working range of a 
neural network) leads to the modification of a neural network's parameters (i.e., weights and 
biases) necessary for learning ("improvement"). The dependent claims 3, 10, 9, and 5, do not 
cure the deficiency of the independent claims; therefore claims 1, 3, 5, and 8-12 are rejected 
under 35 U.S.C. 112, 1 st . 



Claim Rejections - 35 USC § 1 12, 2 nd 

8. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

9. Amended claims 1,3,5, and 8-12 are rejected under 35 U.S.C. 1 12, second paragraph, as 
being indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. Amended independent claims 1, 8, 1 1, and 12 recite 
"improving a neural network prediction. . .based on whether the input data record is in a working 
range of a neural network". However, the Specification states only that a "neural network is 
trained using these training data records, that is to say the weightings of the neurons are adapted 
iteratively" (see [0016]). Clearly, the specification does not conclude with one or more claims 
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particularly pointing out and distinctly claiming the subject matter which the applicant regards as 
his invention as nothing in the disclosure recites how a training or input data record being inside 
or outside of a convex envelope (working range of a neural network) leads to the modification of 
a neural network's parameters (i.e., weights and biases) necessary for learning ("improvement"). 
The dependent claims 3, 10, 9, and 5, do not cure the deficiency of the independent claims; 
therefore claims 1, 3, 5, and 8-12 are rejected under 35 U.S.C. 1 12, 2 nd . 

Claim Rejections - 35 USC § 103 

10. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

11. Claims 1, 8, 9, 10, 1 1, and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Zakrzewski (USPN: 7,203,716) in view of Budinich et al. (Budinich), "Feed-forward 
neural networks: a geometrical perspective", 1991. 

Regarding claim 1 . (Currently amended) Zakrzewski teaches a method for improving a neural 
network prediction (s ee Abstvact,_Examiner interprets "training and verifying neural networks " 
to be methods for improving a neural network prediction.\Jor an input data record being 
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manufacturing process data selected from the group comprising data related to the materials 
used, composition data, parameters of the production system, pressure data and/or t emperature 
data (see col. 1, lines 20-21, E xaminer interprets the experimental data that may be used to 
model physical or engineering systems to include manufacturing process data selected from the 
group comprising data related to the materials used, composition data, parameters of the 
production system, pressure data and/or temperature.)±compnsmg the following steps: 

(a) storing training input data records for the neural network, forming the convex 
envelope by means of the training input data records (see col. 13, lines 52-60), 

(b) checking whether the input data record is in the convex envelope (see col. 5, lines 20- 
37, Examiner asserts that if the linear combination of the vertices of the simplex used to express 
the point x (the input data) interior to the simplex is convex, such that all coefficients are positive 
and summing to less than 1 , then there is at least one hyper-plane which contains the input data 
record so that all the training input data records are located on one side of the hyper-plane.), in 

(i) selecting a number (d + 1) of non-collinear points from the set of training input 
records (see col. 5, lines 22-29, Examiner interprets n to be the number of dimensions of 
the data space and K to equal 1 since the "particular value for K used may vary in 
accordance with the particular considerations of each embodiment".), 

(ii) forming a first simplex (SI) from the selected points (see col. 5, lines 29-31), 

(iii) selecting a point (xl) from the interior of the first simplex (SI) (see col. 5, 
lines 29-31), 
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(iv) defining a path between the input data record and the selected point (see col. 
6, lines 20-25, Examiner interprets the shifted vertices v(n+l) to form a path between the 
input data record and the selected point.), 

(v) checking whether there is an intersection point (xl+1) between the path and a 
facet of the first simplex (see col. 6, lines 35-46, Examiner interprets the convex linear 
combination of n vertices having the origin translated to the remaining n+lth vertex to 
express an intersection point.), and 

(vi) checking whether a second simplex (Sl+1) which contains the intersection 
point and a section of the path can be formed from the number of points from the training 
input data records (see col. 6, lines 52-56, Examiner interprets "the next simplex" to be a 
second simplex.), 

(c) delivering result that input data record is inside or outside the working range of the 
neural network through confirming that the input data is respectively inside or outside the 
convex envelope (see col. 7, lines 1-33, Examiner interprets the evaluation of the fitted 
linear function at point x(hat) to comprise delivering result that input data record is 
inside the working range of the neural network through confirming that the input data is 
respectively inside or outside the convex envelope.). 

Zakrzewski does not teach the prediction being based on whether the input data record is in a 
working range of a neural network, wherein the working range is defined by a_convex envelope 
formed by training input data records of the neural network and (d) improving the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
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used neural network and processing by the used neural network the input data record if it is 
inside the working range. However, Budinich does teach the prediction being based on whether 
the input data record is in a working range of a neural network, wherein the working range is 
defined by a_convex envelope formed by training input data records of the neural network {see p. 
884, Corollary para. 2, "Since the convex hull is also the intersection of the half-spaces 
determined by its supporting hyperplanes, we see immediately how to build a feed-forward 
neural network with the property of selecting all and only the given examples. . .", Examiner 
interprets a feed-forward neural network built from association with a "convex hull" to be a 
neural network whose prediction (mapping some input to some output) is based on whether the 
input data record is in a working range of a neural network, wherein the working range is 
defined by a convex envelope formed by training input data records of the neural network .). 
Budinich also teaches (d) improving the neural network prediction by disregarding the input data 
record if it is outside the working range of the used neural network and processing by the used 
neural network the input data record if it is inside the working range {see p. 884, Corollary para. 
1 , Examiner interprets cutting off extreme points of a convex hull "yielding another, 'smaller ', 
convex set" to be improving the neural network prediction by disregarding the input data record 
if it is outside the working range since the neural network is constructed from the smallest 
convex set of a series of cuttings.). 

It would have been obvious at the time the invention was made to persons having ordinary skill 
in the art to combine Zakrzewski with Budinich to apply some theorems of n-dimensional 
geometry to digital feed- forward neural networks and use the construction of the convex hull as 
an alternative to more traditional learning algorithms. 
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Regarding claim 8. (Examiner amended) Zakrzewski teaches a system (see Fig. 3 and col. 12, 
line 42 to col. 13, line 5 1) for improving a neural network prediction ( see Abstract, Jsxamz'wer 
interprets "training and verifying neural networks " to be methods for improving a neural 
network prediction. )_for an input data record being manufacturing process data selected from the 
group comprising data related to the materials used, composition data, parameters of the 
production system, pressure data and/or temperature data (see col. 1, lines 20-21, E xaminer 
interprets the experimen tal data that may be used to model physical or engineering systems to 
include manufacturing process data selected from the group comprising data related to the 
materials used, composition data, parameters of the production system, pressure data and/or 
temperature.);, comprising 

at least one neural network which has been trained using a set of training input data 
records (see col. 13, lines 52-55); 

means for improving the neural network prediction by checking the input data record 
relative to the convex envelope which is formed by the training input data records (see col. 5, 
lines 20-37, Examiner asserts that if the linear combination of the vertices of the simplex used to 
express the point x (the input data) interior to the simplex is convex, such that all coefficients are 
positive and summing to less than 1 , then there is at least one hyper-plane which contains the 
input data record so that all the training input data records are located on one side of the hyper- 
plane.); 

a hybrid model which contains at least a first neural network and a second neural 
network, the first neural network having been trained using a set of first training input data 
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records, and the second neural network having been trained using a set of second training input 
data records, the improving means being embodied in such a way that for a first input data record 
for the first neural network it is checked whether the first input data record is in the convex 
envelope which is formed by the first training input data records, and that it is checked for a 
second input data record for the second neural network whether the second input data record is in 
the convex envelope which is formed by the second training input data records, the assignment 
of the first input data record to the first neural network and the assignment of the second input 
data record to the second neural network being carried out in automated fashion from a 
composite data record {Examiner asserts that this "hybrid model" is simply two neural networks 
performing the method of claim 1.). 

Zakrzewski docs not teach the prediction being based on whether the input data record is 
in a working range of a neural network, wherein the working range is defined by a_convex 
envelope formed by training input data records of the neural network and (d) improving the 
neural network prediction by disregarding the input data record if it is outside the working range 
of the used neural network and processing by the used neural network the input data record if it 
is inside the working range. Budinich does teach the prediction being based on whether the input 
data record is in a working range of a neural network, wherein the working range is defined by a 
convex envelope formed by training input data records of the neural network {see p. 884, 
Corollary para. 2, "Since the convex hull is also the intersection of the half-spaces determined by 
its supporting hyperplanes, we see immediately how to build a feed-forward neural network with 
the property of selecting all and only the given examples. . .", Examiner interprets a feed-forward 
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neural network built from association with a "convex hull" to be a neural network whose 
prediction (mapping some input to some output) is based on whether the input data record is in a 
working range of a neural network, wherein the working range is defined by a convex envelope 
formed by training input data records of the neural network .). Budinich also teaches 
disregarding the input data record if it is outside the convex envelope and processing by the used 
neural network the input data record if it is inside the convex envelope (see p. 884, Corollary 
para. 1, Examiner interprets cutting off extreme points of a convex hull "yielding another, 
'smaller ', convex set" to be improving the neural network prediction by disregarding the input 
data record if it is outside the working range since the neural network is constructed from the 
smallest convex set of a series of cuttings.). 

It would have been obvious at the time the invention was made to persons having ordinary skill 
in the art to combine Zakrzewski with Budinich to apply some theorems of n-dimensional 
geometry to digital feed- forward neural networks and use the construction of the convex hull as 
an alternative to more traditional learning algorithms. 



Regarding claim 9. (Original) Zakrzewski teaches the system according to Claim 8 wherein the 
checking means being embodied in such a way that the checking is carried out in accordance 
with a method according to Claim 1 (see Fig. 3 and col. 12, line 42 to col. 13, line 51, Examiner 
interprets the system disclosed in Fig. 3 to be a system according to Claim 8 wherein the 
checking means being embodied in such a way that the checking is carried out in accordance 
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Regarding claim 10. (Original) Zakrzewski teaches computer digital storage medium program 
product for carrying out a method according to Claim 1 (see Fig. 3 and col. 12, line 42 to col. 13, 
line 51, Examiner interprets the Data Storage System 52 to be a digital storage medium program 
product for carrying out a method according to Claim /.). 

Regarding claim 1 1 . (Currently amended) Zakrzewski teaches a method for improving a neural 
network prediction (s ee Abstra.ct,_Examiner interprets "training and verifying neural networks " 
to be methods for improving a neural network prediction, ,}_for an input data record being 
manufacturing process data selected from the group comprising data related to the materials use, 
composition data, parameters of the production system, pressure data and/or temperature date 
( see col. 1, lines 20-21, Examiner interprets the experimental data that may be used to model 
physical or engineering systems to include manufacturing process data selected from the group 
comprising data related to the materials used, composition data, parameters of the production 
system, pressure data and/or temperature.), comprising the following steps: 

(a) storing training input data records for the neural network, forming [[a]] the convex 
envelope by means of the training input data records (see col. 13, lines 52-60), 

(b) checking whether the input data record is in the convex envelope, in checking 
whether there is a hyper-plane which contains the input data record so that all the training input 
data records are located on one side of the hyper-plane (see col. 5, lines 20-37, Examiner asserts 
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that if the linear combination of the vertices of the simplex used to express the point x (the input 
data) interior to the simplex is convex, such that all coefficients are positive and summing to less 
than 1, then there is at least one hyper-plane which contains the input data record so that all the 
training input data records are located on one side of the hyper-plane.), 

(c) delivering a result that input data record is within or without the working range of 
used neural network through confirming that the input data is respectively inside or outside the 
convex envelope (see col. 7, lines 1-33, Examiner interprets the evaluation of the fitted linear 
function at point x(hat) to comprise delivering result that input data record is inside the working 
range of the neural network through confirming that the input data is respectively inside or 
outside the convex envelope.). 

Zakrzewski docs not teach the prediction being based on whether the input data record is in a 
working range of a neural network, wherein the working range is defined by a_convex envelope 
formed by training input data records of the neural network and (d) improving the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
used neural network and processing by the used neural network the input data record if it is 
inside the working range. Budinich does teach the prediction being based on whether the input 
data record is in a working range of a neural network, wherein the working range is defined by a 
convex envelope formed by training input data records of the neural network (see p. 884, 
Corollary para. 2, "Since the convex hull is also the intersection of the half-spaces determined by 
its supporting hyperplanes, we see immediately how to build a feed-forward neural network with 
the property of selecting all and only the given examples. . .", Examiner interprets a feed-forward 
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neural network built from association with a "convex hull" to be a neural network whose 
prediction (mapping some input to some output) is based on whether the input data record is in a 
working range of a neural network, wherein the working range is defined by a convex envelope 
formed by training input data records of the neural network .). Budinich also teaches (d) 
improving the neural network prediction by disregarding the input data record if it is outside the 
working range of the used neural network and processing by the used neural network the input 
data record if it is inside the working range {see p. 884, Corollary para. 1, Examiner interprets 
cutting off extreme points of a convex hull "yielding another, 'smaller', convex set" to be 
improving the neural network prediction by disregarding the input data record if it is outside the 
working range since the neural network is constructed from the smallest convex set of a series of 
cuttings.). 

It would have been obvious at the time the invention was made to persons having ordinary skill 
in the art to combine Zakrzewski with Budinich to apply some theorems of n-dimensional 
geometry to digital feed- forward neural networks and use the construction of the convex hull as 
an alternative to more traditional learning algorithms. 



Regarding claim 12. (Currently amended) Zakrzewsk i teaches a method for improving a neural 
network prediction for an input data record being manufacturing_process data selected from the 
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group comprising data related to the materials used, composition data, parameters of the 
production system, pressure data and/or temperature data , comprising the following steps: 

(a) storing training input data records, forming a convex envelope using the training 
input data records (see col. 13, lines 52-60), 

(b) checking whether the input data record is in the convex envelope (see col. 5, line 17- 

37, Eaminer asserts that steps (i)-(vi) are an obvious variation of steps (i)-(vi) of claim 1 (see 
above) where the vectors used to construct the interior search set are simply normalized and 
thus an obvious variation of interpolation technique ofZakrzewski.), in 

(i) selecting an initial vector X {0) = (X h ..., X n ) with (Xi + ... + X n )=l and Xj >0 (j = 
l,...,n), where preferably X s = 1/n is selected, 

(ii) selecting a matrix M in such a way that the lines matrix p hat(0) = M*P (l) are 
orthonomal, 

(iii) calculating X = X (,) + P hat(l)T * (x hat - x hat(l) ) where x hat(l) = P ha,(l) *X (l \ 

(iv) checking whether all Xj >_0 (for j = l,...,n), 

(v) deleting all components from the matrix P hat(l) and from the vector which 
infringe the secondary condition Xj >0 (for j = l,...,n), 

(vi) renewing calculating of X, and 
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(c) delivering a result that input data record is within or without the working range of the 
used neural network through confirming that the input data is respectively inside or outside the 
convex envelope (see col. 7, lines 1-33, Examiner interprets the evaluation of the fitted linear 
function at point x(hat) to comprise delivering result that input data record is inside the working 
range of the neural network through confirming that the input data is respectively inside or 
outside the convex envelope. 

Zakrzewski does not teach the prediction being based on whether the input data record is in a 
working range of a neural network, wherein the working range is defined by a_convex envelope 
formed by training input data records of the neural network and (d) improving the neural 
network prediction by disregarding the input data record if it is outside the working range of the 
used neural network and processing by the used neural network the input data record if it is 
inside the working range. However, Budinich does teach the prediction being based on whether 
the input data record is in a working range of a neural network, wherein the working range is 
defined by a_convex envelope formed by training input data records of the neural network (see p. 
884, Corollary para. 2, "Since the convex hull is also the intersection of the half-spaces 
determined by its supporting hyperplanes, we see immediately how to build a feed-forward 
neural network with the property of selecting all and only the given examples. . .", Examiner 
interprets a feed-forward neural network built from association with a "convex hull" to be a 
neural network whose prediction (mapping some input to some output) is based on whether the 
input data record is in a working range of a neural network, wherein the working range is 
defined by a convex envelope formed by training input data records of the neural network .). 
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Budinich also teaches (d) improving the neural network prediction by disregarding the input data 
record if it is outside the working range of the used neural network and processing by the used 
neural network the input data record if it is inside the working range {see p. 884, Corollary para. 

1 , Examiner interprets cutting off extreme points of a convex hull "yielding another, 'smaller ', 
convex set" to be improving the neural network prediction by disregarding the input data record 
if it is outside the working range since the neural network is constructed from the smallest 
convex set of a series of cuttings.). 

It would have been obvious at the time the invention was made to persons having ordinary skill 
in the art to combine Zakrzewski with Budinich to apply some theorems of n-dimensional 
geometry to digital feed- forward neural networks and use the construction of the convex hull as 
an alternative to more traditional learning algorithms. 



Response to Arguments 

16. Applicant's arguments filed February 26, 2008 have been fully considered. 

Rejection of Claims 1. 3, and 10 Under 35 U.S.C. §112, \- 



Examiner finds Applicants arguments persuasive and withdraw the rejection of claims 1,3, and 
10 under 35 U.S.C. § 1 12, 2 nd . Examiner provides new grounds of rejection under 35U.S.C. 
§112, 1 st . 
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Rejection of Claims 1, 3, 5. and 8-12 Under 35 U.S.C. §1 12, 2- 

Examiner finds Applicants arguments persuasive and withdraw the rejection of claims 1,3,5, 
and 8-12 under 35 U.S.C. § 1 12, 2 nd . Examiner provides new grounds of rejection under 35 
U.S.C. §112, 2 nd . 

Rejection of Claims 1.3. 5. and 8-12 Under 35 U.S.C. §101 

Examiner finds Applicants arguments persuasive and withdraw the rejection of claims 1, 3, 5, 
and 8-12 under 35 U.S.C. §101. 

Correspondence Information 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Nathan H. Brown, Jr. whose telephone number is 571-272- 8632. The 
examiner can normally be reached on M-F 0830-1700. If attempts to reach the examiner by 
telephone are unsuccessful, the examiner's supervisor, David Vincent can be reached on 571- 
272-3080. The fax phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. Information regarding the status of an application may be obtained 
from the Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For more 
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information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions 
on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217- 
9197 (toll-free). 



Nathan H. Brown, Jr. 
May 6, 2008 

/David R Vincent/ 

Supervisory Patent Examiner, Art Unit 2129 



